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Abstract 

, I 

I We study the optimal execution problem in the presence of market impact where the 
^ • security price follows a geometric Ornstein Uhlenbeck process which has mean reverting 

Li^ . property and show that an optimal strategy is a mixture of initial/terminal block liqui- 

dation and intermediate gradual liquidation. Mean reverting property is strongly related 
to the resilience of market impact, as in several papers which have studied optimal exe- 
cution in a limit order book (LOB) model, such as Alfonsi et al. [1] and Obizhaeva and 
Wang [13]. It is interesting that despite the fact that the model in this paper is different 
from the LOB model, the form of our optimal strategy is quite similar to those of [1] and 
^ ■ [13]. Our results in this paper is also placed as a representative and significant example of 

C*~- . the (generalized) framework of Kato [TT] where market impact causes gradual liquidation. 
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1 Introduction 

^ ■ The basic framework of the optimal execution (liquidation) problem was established in 

^ . Bertsimas and Lo[5] and the theory of optimal execution has been developed by Almgren and 

Chrissjl], He and Mamaysky[8], Huberman and Stanzl[TO]. Subramanian and J arrow [T6] and 
many others. Such a problem often shows up in trading operations, when a trader tries to 
execute a large amount of a security. In these cases, he/she should be careful about liquidity 
problems and especially should never neglect the market impact (MI) which plays an important 
role. MI means the effect that a trader's investment behavior affects on security prices. 
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To study MI for a trader's execution policy, we consider a case where a trader sells his/her 
shares of the security by predicting a decrease in price of the security. In a frictionless market, 
a (risk neutral) trader should sell all the shares as soon as possible, so his/her optimal strategy 
is the block liquidation at the initial time. However, in the real market a trader takes time to 
liquidate. So it is significant to find out what factors cause such gradual liquidation. 

Convexity of MI is one of the reasons to dissuade a trader from block liquidation. As shown 
in examples in Kato[Tl], when a trader is risk neutral and the market is Black Scholes type, a 
quadratic MI function causes gradual liquidation whereas a block liquidation is optimal when 
MI is linear. However, many traders in the real market execute their sales by taking time in 
spite of recognizing that MI is not always convex. Risk aversion of a trader's utility function 
also affects a trader's execution policy motivating an incentive to take more time for trading. 
Schied and Schoneborn[T5] consider an optimization problem in relation with a risk averse 
utility function and clarify the relation between the measure of risk aversion and the form of 
optimal strategies. 

Another important motive is that due to the effect of MI, security price may recover after 
downward movement in price. In this paper, to consider the price recovery effect, we focus on 
the case where the process of a security price has the mean reverting property, especially when 
it follows a geometric Ornstein Uhlenbeck (OU) process. We adopt the framework of Kato|ll]: 
we first consider discrete time models of an optimal execution problem and then derive the 
continuous time model as their limit. To treat the geometric OU process as a security price 
process, we generalize the main results of Kato[TT] mathematically. We explicitly solve the 
optimization problem with linear MI and show that the optimal strategy is a mixture of 
initial/terminal block liquidation and intermediate gradual liquidation. Our example in this 
paper is also placed as a representative case where a gradual liquidation is necessary in the 
framework of Kato[TT] even if there is linear MI and the trader is risk neutral. 

Our result is strongly related to studies of the limit order book (LOB) model. In the LOB 
model, a trader's selling decreases buy limit orders, thus expanding the bid ask spread tem- 
porarily, and new buy limit orders appear, letting the bid ask spread shrinks as time passes. 
The minimization problem of expected execution cost in a block-shaped LOB model with 
exponential resilience of MI is studied in Obizhaeva and Wang[T3]. A mathematical general- 
ization of the results of Obizhaeva and WangfTB] is given in Alfonsi et al. pQ and Predoiu et al. 
^^. Moreover, Makimoto and Sugihara[T2] treat a model of optimal execution under stochas- 
tic liquidity. It is interesting that despite the fact that the model in this paper is different 
from the LOB model, the form of an optimal execution strategy in our model becomes quite 
similar to the results in these papers. Indeed, when our security price process has no volatility, 
the form of our optimal strategy coincides with those in Alfonsi et al. [1] and Obizhaeva and 
Wang[T3]: the speed of intermediate liquidation is constant. When the volatility is larger than 
zero, the speed decreases as in Makimoto and Sugihara|12]. 

This paper is organized as follows. In Section |2l we review our model of optimization 
problems and list our assumptions. In Section [3l we give some generalizations of the results 
of Kato[Tl], in particular the convergence of the value functions. Section H] is our main inter- 
est. We introduce the optimization problem in the geometric OU price process and solve it 
explicitly. Section \5\ gives a note on the positivity of an optimal strategy and the possibility 
of price manipulation in our framework. Section [6] summarizes our studies. Section [7] gives 
the proofs of our results. 



2 The Model 

Our model is the same as in Kato[ll] except for some technical assumptions. Let (fi, J^, 
(J-'t)o<t<i, -P) be a filtered space which satisfies the usual condition (that is, {J^t)t is right 
continuous and J-q contains all P-nuU sets) and let (-Bt)o<<<T be a standard one dimensional 
(J-'f)f-Brownian motion. 

First we consider the discrete time model with time interval 1/n. We assume that trans- 
action times are only at 0, 1/n, . . . ,{n — l)/n for n G N = {1, 2, 3, . . .}. We suppose that there 
are only two assets in the market: cash and a security. The price of cash is always equal 
to 1. We consider a single trader who has an endowment of $o > shares of the security. 
This trader executes the shares $o over a time interval [0, 1], but his/her sales affect the price 
of the security. For / = 0, . . . ,n, we denote by S"" the price of the security at time l/n and 
X" = log S"". Let So > be the initial price (i.e., 5*0 = sq) and X^ = log sq. If a trader sells the 
amount ■?/'" at time l/n, the log price changes to X" — gniipi"), where gn '■ [0, oo) — ;■ [0, oo) is 
a nondecreasing and continuously differentiable function which satisfies gn{0) = 0, and he/she 
gets the amount of cash '?/'"S'"exp(—(7„ (■?/'")) as the proceeds of his/her execution. After the 
trade at time l/n, X]]^^ and Sl'_^i are given by 

xr+, = Y(^-±^;-,xr-gnW)). ^r+i = exp(xr+i), (2.1) 

\ n n / 

where Y{t;r,x) is a solution of the following stochastic differential equation (SDK) 

dY{t;r,x) = a{Y{t;r,x))dBt + biY{t;r,x))dt, t > r, 
Y{r; r,x) = X 

and 6, 0" : M — > M are Lipschitz continuous functions. We assume that the functions b, a, b 
and a are linear growth, where a{s) = sa{\ogs),b{s) = s{fe(logs) + cr(logs)^/2}. We notice 
that b and a are assumed to be bounded in Kato[Tl], so the model in this paper is a slight 
generalization of Kato[TT]. In our model, we remark that there is a unique solution of 02. 2p 
for each r > and x G M. 

At the end of the time interval [0, 1], the trader has the amount of cash W^, where 

W^r+i = Wr + C^r exp(-<7„(C)) (2.3) 

for / = 0, . . . , ra — 1 and Wq = 0. We define the space of a trader's execution strategies A^i^ip) 
as the set of {ip^)flQ such that tjj]^ is J-;/„-measurable, tjj]^ > for each / = 0, . . . , A; — 1, and 

1=0 

The investor's problem is to choose an admissible trading strategy to maximize the ex- 
pected utility E[u{W^,(p'^, Sll)], where u E C is his/her utility function and C is the set of 
nondecreasing continuous functions on D = R x [0, $o] x [0, C)o) which have polynomial growth 
rate. 

For k = l,...,n, {w,ip,s) G D and u G C, we define a (discrete time) value function 
V,^{w,ip,s;u) by 

V,^w, ^, s; u) = sup EHW^, ^l SJ^)] 



subject to ([211]) and ([O]) for / = 0, . . . , A; - 1 and {W^, ^l, S]^) = {w, ip, s). (For s = 0, we 
set 5*" = 0.) For A; = 0, we put V^{w, ip, s; u) = u{w, (p, s). Then our problem is the same as 
Vj^{0, $0, So; u). We consider the hmit of the value function V^{w, (p, s; u) as n — )■ oo. 

Let h : [0, oo) — > [0, oo) be a nondecreasing continuous function. We introduce the 
following condition. 

[A] lim sup 'T79n{'4') ~ h{n%l}) 



n— >oo 



V-elo,*!)] 



< 



0. 



Let g{C) = / h{C')dC,' for C, G [0, oo). The function g{C) means an MI function in the 
Jo 
continuous time model. For t E [0, 1] and cp E [0, $o] we denote by At{(p) the set of (J>.)o<r<r 

progressively measurable process (Cr)o<r<t such that Cr > for each r E [0,t], / (rdr < 

Jo 

tp almost surely and supCr(i^) < oo. For t E [0, 1], (w;, </?, s) E D and n G C, we define 
Vt{w,^,s;u) by 

Vt{w,ip,s;u) = sup E[u{Wt, ipt, St)] 

(Cr)rGA{¥') 

subject to 

dWr = CrSrdr, dipr = —(rd^, dSr = a{Sr)dBr + b{Sr)dr — g{(r)Srdr 

and {Wo,(po, So) = {w,(p,s). When s > 0, we obviously see that the process the log price of 
the security Xr = log 5"^ satisfies 

dXr = a{Xr)dBr + b{Xr) - g{Cr)dr. (2.4) 

3 Derivation of Continuous Time Model 

Following results are similar to the ones in Kato|ll]. 
Theorem 1. Assume [A]. For each {w, ip,s) E D, t E [0, 1] and u E C, 

lim Vr[;fi(w,v3,s;M) = Vt(w, v?, s; m), (3.1) 

where [nt] is the greatest integer less than or equal to nt. 

Here we make the further assumption 
[B] E[ sup exp(r(t; 0, x))] < Ce^ for some C > 0. 

0<t<l 

Theorem 2. Assume [B] . For u E C, the function \4(w, (/?, s; u) is continuous in {t, w, ip, s) E 
(0,1] X D. Moreover, if h{oo) < oo, then Vt{w,(p,s;u) converges to Ju{w,(p,s) uniformly on 
any compact subset of D as 1 10, where 

sup m(w + -— s,(/?-7/;,se-''(°°)^) (/i(oo) > 0) 

^g[o,<^] V /i(oo) / 

sup n(ii; + ?/^s, V9 — ^, s) (/i(oo) = 0). 



Theorem 3. Assume [B]. For each r,t & [0, 1] with t + r < 1, [w,if,s) G D and u & C it 
holds that Qt+ru{w, (p, s) = QtQru{w, (p, s). 

Next we consider a sell out condition, which is referred in Section 4 in Kato[TT]. We define 
some spaces of admissible strategies with the sell out condition as 

An^) = {(Cr)r e M^) ; ^ Crdr = ^\ . 

Now we define value functions with the sell out condition by 

lC'^°(^,¥.,s;f/) = sup E[U{Wn], 

y,^0(^,y.,s;[/) = sup EpiWt)] 

for a continuous, nondecreasing and polynomial growth function U : M — > M. By Theorem 
[H 121 and similar arguments as in Kato[Tl], we can show the following. 

Theorem 4. It follows that Vr^n {w, (p, s; U) — > V^'^{w, (p, s; U) = Vt{w, (p, s; u) as n ^ oo, 
where u{w, (p, s) = U{w) . 

Under the assumptions of this paper, we also obtain all the lemmas in Section 7.1 of 
Kato[Tl], except Lemma 1 and Lemma 4. Instead, we have the following lemmas. 



Lemma 1. For each m E'H there is a constant C > depending only on b, a and m such that 
E[^(s)n < C{1 + s""), where Z{s) = sup Z{t; 0, s). 



0<i<l 



Lemma 2. Let t G [0, 1], ^9 > 0, a; G M, (Cr)o<r<t £ •At{'~p) and let (Xr)o<r<t be given by (12. 4p 
with Xq = X. Then there is a constant C > depending only on b and a such that 



E 



sup 

^re[ro,ri] 



Xr - Xro + / g{Cv)dv 
Jro 

2ri I /'^ ^ ^3 / T^r^/'/" ^4l 



< Cir,-roy{l + {r,-ror E[^(C.)1M (3.2) 

Jro 

for each < Tq < ri <t. 

Unlike the case where b is bounded, the right hand side of (13. 2 p depends on {Cr)r- However, 
this makes no essential problem for proving similar results to Kato[TT], except the continuity 
of the continuous time value function at t = when h{oo) = oo. Thus we can complete the 
proofs of Theorems [T]-[5] similarly to Kato [TT] . 



4 Example: Geometric OU Process 

In this section we consider an example which is our main interest in this paper. Let /3, cr > 
and F e M. We set b{x) = (3{F — x) and a{x) = a. In this case the solution Y of (12.21) is 
called an Ornstein Uhlenbeck process and we can write the explicit form of the log price {Xj.)r 
as 
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We notice that the condition [B] is fulfilled. 

Then we consider the case where MI is linear and the trader is risk neutral, that is, 
g{() = a( for some a > and u{w, ip, s) = urn(w^5 '^, s) = w. For brevity we set y = a^/{4:f3) 
and z = logs — F. We assume z > 2y{> 0) so that the security price goes down to the 
fundamental value e as time passes. Note that the trader in a fully liquid market should sell 
all the securities at the initial time i.e., the optimal strategy is an initial block liquidation. In 
fact, if (f is small enough, the trader's optimal policy is almost the same. 

Theorem 5. If f < {z — 2y)/a, then it holds that 

1 — e"""^ 

Vt{w,(p,s;uYiN) = w-\ s. (4.1) 

a 

The form of (14. ip is the same as in Theorem 8 of Kato[ll]. The trader's (nearly) optimal 
strategy is given by C/' = (pl[o^s]ir)/6 with 5 — )■ 0. We call such a strategy an "almost block 
liquidation" at the initial time. 

When if is not so small, the assertion of the above theorem is not always true. The trader's 
selling accelerates the speed of decrease of the security price, and a quick liquidation is not 
always appropriate when we consider the effect of MI. Moreover, if the trader's execution 
makes the price go under e transitorily, the price will recover to e by delaying the sale. This 
gives a trader an incentive to liquidate gradually. Our purpose in the rest of this section is to 
derive a (nearly) optimal execution strategy explicitly. 

Let P{x) = e~°'^{l — ax). Since the function P is strictly decreasing on (— oo, 2/a], we can 
define its inverse function P~^ : [— e~^, cxo) — y {—oo,2/a]. Moreover we define the function 
H{X) = Ht,^{\) on [0, oo) by 

H{\) = aexp I a/? / P~^ (exp(— e~^^''?/)A/a) dr — aip + z — y\ — A, 

We assume the following condition 

^ > ^^AzA + P}_ ^4 2) 

a 

This condition means that the amount of the trader's security holdings is large enough. We 
see that H is nonincreasing on [0, oo) and (14.21) implies 

H{ae-y) <0<H{0). 

Then the equation H{\) = has the unique solution A* = X*{t,Lp) E (0,ae~^). The next 
theorem is the main result in this section. 
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Theorem 6. Let t G (0, 1], {w, (f,s)^D and assume (14.21) . Then 

Vt{w,ip,s;uR^) = w -\ — ll-expl-aip + af3 Cdrjj 

+/3 [ C exp {F - aC + (1 + e-^^'y)) dr, (4.3) 

where C = P~\exp{-e-^^'y)X* /a). 

We can construct a nearly optimal strategy as follows (with 5^0): 

C' = ylM]W + C + yl[*-.,t](r), (4.4) 

where p* = Q + {z — 2y)/a and 

.* ^ n,. . 2/3X*e-^^^yexp{aC-e-^^'y) 2Jy_ _^^^ 
^^ ^^'- ^ a\ail - 2) ^ a"" 



a(2 - a^*) 



^-/3rCrfr-C-- + -(l + e"^^*)- 



Here the second equality of the definition of Q. comes from P{^*) = exp(—e~'^^^y) x X* /a. By 
the inequalities (14. 2p . z > 2y, and < ^* < ^q — V*^) "^^ see that p*, (* and g* are all positive. 
The strategy {Cr)r consists of three terms. The first term in the right hand side of (14.41) 
corresponds to "initial (almost) block liquidation." The trader should sell p* shares of a 
security at the initial time by dividing infinitely to avoid a decrease in the proceeds. The 
second term means "gradual liquidation." The trader executes the selling gradually until the 
time horizon. The speed of his/her execution becomes slower as time passes. Then the trader 
completes liquidation by selling the rest of the shares by "terminal (almost) block liquidation" 
as the final third term. So the nearly optimal strategy is a mixture of both block liquidation 
and gradual liquidation, and especially we point out that the gradual liquidation is necessary 
in this case. Figure [1] expresses the image of an optimal strategy of the trader. Using these 
notations, we can rewrite the value function (14. 3 p as the sum of an initial cash amount and 
proceeds of initial/intermediate/terminal liquidation: 

= w + s + s / e"""* (dri; + /3Crdr) + se"""* , (4.5) 

a Jo a 

where r]* = Q - (1 + e^^^*)y/a + z/a. 

Here we consider the special case of a = for a while. In this case the form of the value 
function and its nearly optimal strategy becomes simple and we can weaken the assumption 
(14.21) to (/) > z/a. We define the function C{p) = Ct,^{p), x G M, by 

Ct,M = e''P-'Ht,^{aPixp-z/a))/a 

= exp{a{t/3 + l)p — aip — tf3z) + ap — z — 1. 



^ 



o 

S 
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Almost block liquidation 




Figure 1: The form of a nearly optimal strategy {Cr)r (the upper graph) and the corresponding 
process of the amount of the security holdings (the lower graph) when cr > 0. Horizontal axis 
is the time r. 



Since C{p) is strictly increasing and C{z/a) < < C {{ip — z/a)/{l + f3t)), the equation 
C{p) = has a unique solution p* = p*{t, ip) & {ip — z/a, {ip — z/a)/{l + /3t)). We have the 
following. 

Corollary 1. Let t G (0, 1], [w, ip,s) E D and assume ip > z/a. Then it holds that 



1 — e~°(^*+'^*) 
Vt{w, ip, s; mrn) = w H : s + tse~°'P (* 



a 



(4.6) 



where (* = C*(t, V') o.iT'd q* = q*{t, ip) are given by 

C = (3{p*-z/a), q* = ^-p*-tC. 
We see easily that p*,(*,q* > 0. A nearly optimal strategy is 

C^ = ^l[o,5](r)+tC + yl[*-5,](r). 

In this case we also decompose a nearly optimal strategy into three parts: initial (almost) 
block liquidation, gradual liquidation, and terminal (almost) block liquidation. Moreover the 
speed of the gradual liquidation (* is constant. The image of their form is in Figure [21 In 
fact, the security price is equal to se~"^ and is also constant on {6, 1 — 6). 

This result is quite similar to Alfonsi et al.[T] and Obizhaeva and Wang[T3]. despite the 
fact that there is a little difference between their models and ours. We consider the geometric 
OU process for a security price. On the other hand Alfonsi et al.[T] and Obizhaeva and 
Wang[T3] assumed that the process of a security price follows arithmetic Brownian motion 
(or a martingale) and there is exponential (or some more general shape of) resilience for MI 
in LOB model. The relation between the mean reverting property of an OU process and the 
resilience of MI causes the similarity of results. 



5 A Note on Price Manipulation 

In a viable execution model, the absence of price manipulation should be guaranteed and 
an optimal strategy should always be nonnegative (i.e., a selling strategy should not include 
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-Almost block liquidation 




Figure 2: The forms of a nearly optimal strategy (Cr-)r (the upper graph) and the corresponding 
process of the amount of the security holdings (the lower graph) when cr = 0. Horizontal axis 
is the time r. 



purchasing.) The conditions for viability in a LOB model are studied in Alfonsi and Schied[2], 
Alfonsi et al.[3], Gatheral[6], Gatheral et al.[7], Huberman and Stanzl|9] and others. 

In this section we extend the definition of admissible strategies of our model to permit 
purchasing and consider the possibility of a price manipulation strategy. We consider the 
following optimization problem 



V"/''(w, (/?, s; mrn) = sup E[VFt], 



(5.1) 



where Af'i^ip) is the set of "real valued" progressively measurable processes {Cr)r such that 
C^j-dr < (f. We note that this extended value function is not always derived from corre- 
sponding discrete time value functions, since our convergence theorem (Theorem [T]) is based 
on the assumption that an execution strategy takes nonnegative values. 

In fact, the assumption (14. 2 p is needed only to guarantee p*,Cr^Q* > and the proof of 
Theorem E] itself also works without fji^ . Let (4^)^ be given by (^^ and let (W^,^)r be the 
corresponding process of the cash amount. The proof of Theorem IH] in Section [7^ implies that 

V^'^'^iw, LP, s; Urn) > lim E[Wt] = lim sup Vr";?''(w;, (p, s; urn), 

5^0 n-i-oo ^ ' 

where V,^^^{w, (p, s; urn) is defined similarly to V^^^^i^w, (p, s; urn). Then we have the following. 

Theorem 7. Assume z > 2y. Then for each c/? G M the function V^^^{w, (p, s; mrn) is not less 
than the right hand side of fl4.5p . 



We remark that the equation H{X) = has the unique solution 

aip — z 



X* e {0,ae~yp 



a(l + /3t) 



(5.2) 



even if v? < z/a. In this case p*, (* and q* are not always positive. 

As a special case of (15. ip . we consider the value function ¥^^"^{0, 0, s; urn)- Following Hu- 
berman and Stanzl[9], we call an admissible strategy {(r)r G Af^{0) a round trip and we define 
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a price manipulation strategy as a round trip such that the corresponding expected profit at 
the time horizon is positive. The following theorem indicates that we can construct a price 
manipulation strategy when the initial security price s is much larger than the fundamental 
value e^ . 

Theorem 8. For large enough z there is a price manipulation strategy. 

Proof. The equation H{X*) = implies 

exp (a(3 [ Cdr] = e^-"A7a. 



Then, using Theorem [7] and the relations f l5.2p and .^* < 1/a, we get 



Vr{0,0,s-u^^)>hmEm 



^t)ey-'X*/a + (3ey-' [ exp{e-^^'y - aa)dr\ > -L{z), (5.3) 

Jo } « 



where 



L(z) = 1- (l + /3t + z)exp ( -^^ ) +/3te 



PtZ , , ,,__,_! 



<5^ 



Since lim L{z) = 1, the right hand side of (15. 3p is not less than zero. Then we see that (Cr;r 
is a price manipulation strategy for small enough 6. ■ 

In a LOB model, the possibility of price manipulation is varied by small difference among 
the frameworks of the models. In Alfonsi and Schied[2], there is no price manipulation strategy 
in both linear and nonlinear MI and exponential resilience, but the result of Gatheral[6] asserts 
that price manipulation is possible under exponential resilience unless the MI function is 
linear. Theorem [H] implies the possibility of price manipulation in our framework, although 
the function ( 15.1 p is only a formal generalization of our continuous time value function. 

6 Concluding Remarks 

In this paper we gave a tiny generalization of the results of Kato[Tl] and we solved the 
optimal execution problem in the case where a security price follows a geometric Ornstein Uh- 
lenbeck process. This case is important in the sense that a security price has a mean reverting 
property. We showed that a (nearly) optimal strategy is the mixture of initial/terminal block 
liquidation and intermediate gradual liquidation when the initial amount of the security hold- 
ings is large. When the volatility is equal to zero, our result has the same form as the ones 
in Alfonsi et al.[T] and Obizhaeva and Wang[T3]. In this case a trader should sell at the same 
speed until the time horizon. When the volatility is positive, the speed of gradual liquidation 
is not constant and the form of our optimal strategy is similar to the one in Makimoto and 
Sugihara[T2]. 

Our example gives us a case where MI causes gradual liquidation. In the real market a 
trader sells his/her shares of a security gradually to avoid an MI cost because he/she expects 
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a recovery of the price. As noted in Section [H examples in Kato[TT] also suggest that strictly 
convex MI causes a gradual liquidation. Convexity (or nonlinearity) and a price recovery effect 
are both important factors in the construction of an MI model. 

In Section |5l we considered the optimization problem when the trader is permitted to buy 
the security and we showed the possibility of price manipulation. It is important to construct 
a viable market model of execution, and it is intended, in future work, to find out conditions 
for the nonexistence of price manipulation. To make the arguments in Section |5] strict, we 
need to derive the corresponding convergence theorem such as Theorem [1] and this is another 
remaining task. 

7 Appendix 

7.1 Proof of Theorem [5] 

It is easy to see that Vt{w, cp, s; urn) = w + e^"*"^/(t) holds, where 

fit) = sup fHQr), (7.1) 

{Cr)rG^f'{'P) 

f{iCr)r) = / Cr exp L-^'z - e'^'^^i/ - ae"^'" T e'^^C.^^) dr. 

So it suffices to consider the maximization problem (17. 1|) . 
By a straightforward calculation, we get 

/(t)>lim/((e'^) = ^^^^e^-^. 
s-^o a 

Moreover, for any {Cr)r ^ -^t'^^iv) we have 

KiOr) < f Cr exp [e-^^z - e-^f'^y - ae-^^Vr) dr, 



where tjj. = j C,vdv. From the relation z — 2y > a^p > arjr, we have 

'0 



Thus 



{z ~ y — a?7r} — {e '^'^z — e ^'^'"y — ae '^''q-r} 
(1 - e-^'){z - (1 + e-^')y - arjr) > 0. 



1 — e~°"^ 

/((Cr)r) < / exp(2 -y- aT]r)dr]r < e^~y. 

a 



'0 

Then f{t) < (1 — e~°"^)e^~'^ /a and this completes the proof of Theorem O 
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7.2 Proof of Theorem [6] 

In this section we present the proof of Theorem [61 It follows the outline of Alfonsi et al. 

We fix w, ip, s for a while. For brevity we assume t = 1 until the end of this section. We 
define a function /"(n) by 

r(n) = - sup rW,---,C-i), (7.2) 

where ^^' *^ {ip) is the set of admissible strategies in A^{ip) which are deterministic (we also 
define ^^' '^ ' {(p) similarly), 

= a y^ exp I c^z — c^y — a y^ c^^xi j / nxk exp(— a(nr — k)xk)dr 

k=o V 1=0 J "^'^Z" 

n-l / fc-1 \ 

= ^exp c^^-c^'^y-a^c^'x, (l-e-"^''), x = (xq, . . . ,x„_i) G M" 

fc=0 V /=0 / 

and Cn = e~^''^. Since the function /"(xq, . . . ,x„_i) is nondecreasing in x^-i, we can replace 
^^' '^ ((/)) in (17.21) with A^' "^ ' (v^)- We have the following proposition. 

Proposition 1. It holds that w + e ^^ f^{n) — ;■ Vi(w, </?, s; u) with n ^ oo. 

Proof. Let Pin) = e~^~^{y^{w,ip,s]u) -w). We easily have /"(n) < f^in) and Theorem [1] 
implies Vi(w, ip,s;u) < w + e^^^ liminf f"'{n). On the other hand, by the same arguments as 

in the proof of Proposition 2 of Kato[TT], we can show the inequality w + e^"*"^ lim sup f"'{n) < 

n—^oo 

Vi{w, ip, s; u). Then we have the assertion. ■ 

By the above proposition, we may solve the optimization problem f^{n) (and taking n — > 

oo) instead of calculating Vt{w, p, s; mrn) (or f{t)) itself. 

Let S"((^) = {(xo, . . . , x„_i) G M" ; Xq + ■ ■ ■ + x„_i = (p}. We remark that Al''^''^'^^{p) C 

I 

E'^ip). We set g^(x) = ^ ci-'^x™ and Q^x) = -zc'^ + yc^ + aQl{x). 

m=0 

Lemma 3. It holds that min Qhix) — > — oo as Ixl — ?■ oo on S"((j9). 

fc=0,...,n-l ''^ ' ' ' ^^ 

Proof. It suffices to show that min Qk{x) — > — oo. Take any M > 0. Let x G H"((y9) be 
such that min Qk{x) > — M. Then we have 

k=0,...,n—l 

Xk + c„Xfc_i H h c^xo > -M, fc = 0, . . . , n - 1. (7.3) 

Substituting the equality x„_i + ■ ■ ■ + xq = </? from (17. 3p with k = n — 1 and dividing by 1 — Cn, 
we have 

n-2 /n-2-k \ , , 

A;=0 \ 1=0 / " 
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By ([73]) and ([73]) with A; = ra - 2, we have 

n— 3 /n—Z—k 



IL — O I 'li — O — fx. \ / ^ \ 

jfc=0 \ 1=0 / ^ ™ / 



Calculating inductively, we get 

k' /k'-k 



5^ 1 5^ cM xfc < ( -^ + n - 2 - A;' ) (M + y;) < a„(M + if) (7.5) 

fc=0 Vi=0 / \^ Cn J 

for /c = 0, . . . , ra — 2, where a„ = {(1 — c„)~^ + ra}. 

By ([13]) and ([73]) with A; = 0, we have -M < xq < a„M. Similarly, by ([73]) and (1731) 
with /c = 1, we have —(1 + c„Co,n)Af < xi < (a„ + 1 + c„)M. By an inductive calculation 
we have \xk\ < Cn{M + ys). A; = 0, ... ,n — 2 and moreover the relation x G S"((^) implies 
\xn-i\ < C^nl^ + </5) for some positive constant C„. 

The above arguments tell us that "if a sequence {x^^')i>^ C H"((y9) satisfies lim min 

N^oo k 

Q^{x^^') y^ — oo, then {x^'^')n is bounded," which is the contrapositive of our assertion. ■ 
Lemma 4. It holds that /"(xq, . . . ,x„_i) — ¥ — cxo as \x\ -^ oo on S^^ip). 
Proof. Let A^ip) = 6'""^^^ - e"^, p eM. Then we have 

n-l 



r(^) = E 



fc_i(a^)+?/4'=-'(l-c„) _ „-Q;:(a;)^ 



fc=0 

n-2 

< e^-^-e-«"-(^) + EA„(Q^(x)) 

fc=0 



for any x = (xq, . . . , x„_i) G M". We easily see that the function An has an upper bound CA,r. 
Thus 



nx) < 



e' y - exp(-minQ^(x)) + CA,nn, if Qn-i{x) = minQ^(x), 
gz-y _^ A„(minQ^(x)) + CA,n{n - 1), otherwise. 



Since lim An{p) = — oo, we have the assertion by Lemma [3l 

p—^—oo 

Lemma 5. For each k = 0, . . . ,n — 2, it holds that 

d ~ 

/"(xo,...,x„_i) 



dxk 
d 



-r(xo, . . . , x„_i) + a(l - c„) exp{-cl^y)F^ ^ c^ 'x; - c^^/a 



dxfc+i 

_ exp(-ax) - Cnexp(-acnx - cl^jcj - l)y) 
^k{x) - -, _ 
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Proof. For brevity, set d)^' = c^z — c^y. A straightforward calculation gives 
r{xo, ..., Xn-i) = a exp d^^^ - « XI ^"~'^' 



^^^ 



n-l / fc'-l 

-a 

k'=k+l \ 1=0 



E 'n-'exp I rff) - a 5^ c^'x, ) (1 - e— ^')- (7-6) 

Replacing k with A; + 1, we get 

f) ~ / fe+i 

/"(xo, . . . , x„_i) = a exp d(f ^^^ - " Zl ^n^^"'^' 



n.-l / fc'-l 

-a 

k'=k+2 \ 1=0 

n-l / fe'-l 



E c^^^-^ exp 4'=') - a E c^'x, (1 - e""-^') 

■/=k+2 \ 1=0 J 

-. ,o-. / fe'-l \ 

-la Y: c^:-' exp 4^=') - a J^ c^-'x. (1 - e""^-) 

" fc'=fc+l \ i=0 / 

+aexp ( ci(f+i) _ a^c^+i-^x; ) . (7.7) 



1=0 



By (17. 6p and (17. 7p . we get the assertion. ■ 

We notice that F^ is nonincreasing on E^ and we can define the (nonincreasing) inverse 
function Fj^'~ on [0,oo), where 

i^fe = f-oo,--foc„ + l)y+^°S'" 



Now we define the function Hn{X) by 



n-2 



i7„(A) = aexp a(l - cj EF,"'-^(exp(4'^t/)A/a) - «v. + ^ - ^("-Dy ) - A. 

\ fe=0 

We consider the convergence of if„. Let 7^ (x), -Rfc(x) and G^{x) be 
7^(x) = ax + (1 + c„,)4'^y, 
RUx) = / exp(^(l-c„)7fe(x))(l-^)rf^(7fe(x))^ 

JO 

G^(x) = /3e-''^{ax + {2 + Cr,)cl^y-CnRUx)). 



Moreover we define 



/(g) = #P-(g) - ^^P(«^"(^)) 



dq '^' a(aP-Hg)-2) 
and J^g) = -exp(-24'=y)/(exp(-2cfy)g)G^(F^"'"^(g)). Then we have the following. 

14 



Lemma 6. It holds that 



max sup \n{F^{x) - P{x) + 2e-"^cf y) - G^(x) ^ ^ 0, n -^ oo 

k=0,...,n-l rc(zEJ^nK 

for each compact set K C M. 

Proof. For brevity we denote Cn = 1 — Cn- Using Taylor's theorem, we get 

= e-"-{l-c„(7,"(x)-c„i?^(x))} 
= P{x)-2e-"^cfy + c^GUx)/^. 

Thus it holds that 

\n{F^{x) - P(x) + 2e-"^ey) - GUx)\ < \ncjf3 - 1| ■ \GUx)\. 

Since we have nCn — ;■ /3 as n — > oo and 

|G^(x)| < 2/3e2"l"l+22^(a|x| + a^jxl" + 3y + V), (7.8) 

we obtain the assertion. ■ 

Let eUq) = F-^~\q) - P~\exp{-2cl'y)q) + 2cl'y/a. 

Lemma 7. It holds that 

(i) max sup |£^(g)| — ^ 0, 

fc=0,...,n-lo<q<A/ 

(ii) max sup |ne^(g) - J^g)! — ^0 

fc=0,...,n-lo<g<M 

as 7T, —)■ oo /or eac/i M > 0. 

Proof. The assertion (i) is a direct consequence of the assertion (ii), so we will prove only (ii). 



Take any q G [0,M] and let x^ = Fj!' (q). Since F^{x) is nondecreasing with respect to 
and k for each fixed x, we get x^ G Km for any n and k, where 



n 



K 



M 



.1,-1.,. ^ /3 



i^o'-^M), 



a(l - e-/^ 
Let ^^(x) = F^"(x) - P{x) + 2e-''''cl^y. By the relation 

P(x^)-2e-"-^4^ + ^^(x^) = g, 
we get 

Pixl + 2cl'y/a) = exp(-2cf y)(g - P^(x^)). 
Since Lemma [6] implies 



max sup \R'^{x)\ — > 0, n — )■ oo, (7.9) 

fc=0,...,n-l^g^^^n£;n 
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we see that exp{—2c'^y)(q — R'^{x'^)) > —e ^'^/2 > — e ^ for large enough n and A; = 0, 
1, and we get 



n- 



Since it follows that 



xl-P-'iexpi-2cfy)q) + 2cfy/a 
p-\exp{-2cl'y)q) - p-\exp{-2cl%){q - /?^(x^))). 



-2e^/ya < I{q) < < ^I{q) < Ue^a 

dq 



for each x > —e ' /2, we have 



Hxi 



P~\exp{-2cl%)q) + 2cfy/a) - J^{q)\ 



< 



< 



I{exp{-2Cy/a){q - vRl{xl)))dvnRl{xl) - I{exp{-2cfy)q))Gl{x^ 





2e3/2 



nRl{xl] 



Gl{xl] 



\2e' 



\Ki?^l)\-\Gl{xl)\. 



a a 

By Lemma El (17.81) . and (17.91) . we obtain the assertion (ii). ■ 

By Lemma [3, we get the following proposition. 
Proposition 2. if„ converges to H uniformly on any compact set in M. 

By Proposition |2] and the fact that Hn is strictly decreasing on [0, oo), we can take n large 
enough so that there is a unique solution A" of Hn{X) = on (0,2A*). Moreover it follows 
that A" converges to A* as n — )■ oo. 

We set ^^ = 7;(A"), fc = 0, . . . , n - 1, where 

7^(A) = Fg" "^(exp(i/)A/a) + z/a, 

%{X) = Fr\exp{cl'y)X/a) - c„F^-^(exp(cf -i)y)A/«), k = 1, 



,n 



n— 3 



r._i(A) = ^ - (1 - Cr,)J2K'-\^Mcfy)XM 



n-2 



k=0 



(exp(c^("-2)y)A/a) - z/a. 



Lemma 8. It holds that \ipQ — p* 
Proof. By Lemma [TJ we have 



max \nijj^ - Q„| + |C-i - 1* 



as n —7- OO. 



fc=l,...,n-2 



< C\\n{l-Cn) - Pl+En + Sn 



max k^I?-C/nl + K-i-g* 



+ max 

fc=0,...,n-l 



J{ -,exp{cl%)r/a 
n 



J 



n 



,exp(cf-^V)A7« 
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for some positive constant C depending only on a, /3, y, and z, where 

J{r,q) = exp(-2e-^^|/)J(exp(-2e-^^|/)g)G'(r,F(r,g)), 

F(r,g) = p-^(exp(-e-2^'^y)g)-2e-2^V« 

and £„ (respectively, e„) is the left hand side of Lemma [Tl^i) (respectively, (ii).) Since J is 
continuous on [0, 1] x [0, oo), we get the assertion. ■ 

Lemma m and the relations p*, C*? *?* > imply the following lemma. 

Lemma 9. It holds that ^^^ > 0, A; = 0, . . . , n — 1 for large enough n. 

Now we define an {n + l)-variable function £„(xo, . . . , Xn-i-, A) by 

£„(Xo, . . . , Xn-l, A) = /"(Xo, . . . , Xn-l) + \{^ - Xq Xn-l). 

Then we have the following. 

Lemma 10. When n is large enough, the vector {tp^, . . . yipn-i, A") is the unique solution of 

d d d 

-Ln=--- = ^ Cn = -TZrCn = 0. (7.10) 



r\ — n r^ — Ii r\ \ ' 

OXq uXn~\ (J A 

Proof. Suppose that a vector (xq, . . . , Xn-i, A) is a solution of (I7.10p . Then we have xq H — ■ + 
Xn~i = ^ and Lemma |5] implies 






~X = Cn~X + a(l - c„) expi-cfy)F^ ( ^ c^ 'xi - clzjt 
thus 

J]c^'xz = F,"'-^(exp(c2'=y)A/«) + c^/«. A; = 0, . . . ,n - 2. (7.11) 



k 



1=0 



Then we see that Xk = Tk{X), k = 0, . . . ,n — 1. Then we have 

d ^ ^ ~ 

= 7" Cn{Xo, . . . ,Xn, X) 

OXn~l 



71- 1 



= aexp ic'^-'z - cl^^~''>y - aJ2(^n~'''S:i\ - A = i7„(A). 

Since A"^ is the unique solution of Hn{X) = 0, we have A = A". This equality also imples 
Xk = '7fc(A") = ip]^, k = 0,...,n — 1. Thus the solution of (I7.10p is unique. The above 
arguments also tell us that (^q , . . . , ipn_i, A") satisfies (I7.10p . ■ 

Now we have the following proposition. 
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Proposition 3. It holds that f^{n) = f^iipQ, . . . ,ipll_i)/a for enough large n. 

Proof. By Lemma HI we can find M > large enough so that f^{x) < holds for x G 
H"((y9) with |x| > M. Then /" has at least one local maximum point on {—M.,M)'^ (x = 
(xo7 • • • 5 5„_i), say.) By the Lagrange multiplier method, we see that there is some A G M such 
that fl7.10p holds at (x, A). Then Lemma ITO] implies Xk = ip^ ^^ k = 0, . . . ,n — l. This means 
that [ipi, . . . ,ipn-i) is the unique local maximum, which is inevitably the global maximum of 
r on H"((^). ■ 

Now we prove Theorem [61 We divide /"(V'o' • • • 5 ^n-i) i'^to ^^e following three parts: 

rW,...,C-i) = e^-y{l-e-^^o) 

n-2 / fc-1 \ 

+ ^ exp c'^z - cl'y - a ^ c^'^f (1 - e'-'^^) 



fc=i 



1=0 

n-2 



+ exp I c:~h - cl^-~''>y -aJ2 c^^'k (1 - e""'^"- 



fc=0 



^n + -On + ^n- 



By Lemma [HI we easily get 



A„ — > e'^Hl - e-"P 



n — !> 00. 



(7.12) 



Using the relation (17. lip and Lemmas U\^ we have 



Gr> 



exp [ [C-' - cl-')z - c^-'k - aF:L,\exp{cT-'^y)Xya: 

x(i_e-"'^"-i) 

exp {e~^^y - aP~\exp{e~^'^y)X* /a)) (1 - e'^^*) 

^z-y^-anU-^_^-ag'Y 



(7.13) 



To calculate the limit of -B„ we set 



n-2 



^n = -Y^ exp (cf 7/ - a;^^/„) Q/n- 



k=l 



Then we have 



■n-2 



\B„-Bj<eU > '|e""^'^-e- 



-"n -'-^n\ 



n-2 



E 

, fc=i 

^2fc„ 






n-2 

+E 

fc=i 

„2fc„ \ \n 



«c: 



1 -aQ, In "^^kjn 

p ^k/n' ' 

n 



+ ^Sh^P(-^''^-"^^"' '(exp(cf|/)A7a)-exp(cf?/-</n) C/n 
fc=i 

-7-0, n ^> 00 



(7.14) 
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by virtue of (17. lip and Lemmas [3-[Hl Moreover we have 

lim Bn = a [ exp(e-'^"j/ - aOQdr = ae'-^ [ e"""* ( /3C + ^V^] dr 
n-,00 Jo Jq \ dr J 

= a/3e"-^ /" e-"^*C^r + e"-^(e-"P*-e-"^*)- (7-15) 

Jo 

By fl7.12p - fl7.15l) . we see that w + e^~^^{An + B^ + Cn) converges to the right hand side of 
(14.51) . Then we obtain the assertion by Proposition [1] 
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